IMAGE PROCESSING METHOD , IMAGE PROCESSING APPARATUS AND 
RECORDING MEDIUM STORING PROGRAM THEREFOR 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to an image processing 
condition setting method for setting image processing 
conditions for image data obtained by a digital camera. The 
m present invention also relates to an image processing method, 

10 an image processing apparatus and a computer - readable 

recording medium storing a program to cause a computer to 

iy 
. & 

lfj execute the image processing method. 

Hj 

[~ Description of the Related Art 

o 

^ A digital camera can record an image obtained by 

as : 

iy ... 

15 photographing, as digital image data m an internal memory 

O 

1^ installed in a digital camera or in a recording medium such 

as an IC card. Based on the digital image data recorded in 
the above manner, the image can be displayed by using a printer 
or a monitor. In the case where an image obtained by a digital 

20 camera is printed, the print is expected to have as high a 

quality as a photograph generated from a negative film. 

Therefore, tone correction processing and color 
correction processing is generally carried out on image data 
obtained by a digital camera. Since each model of digital 

25 camera has different characteristics of tones , density, colors 

and the like, it is necessary for processing conditions 
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corresponding to an individual model to be acquired for image 
data obtained by a camera of that model, in order to obtain 
reproduced images having a uniform quality. The above 
characteristics depending on the model of the camera are then 
corrected by using the processing conditions. 

Meanwhile, in the field of printing, a system for 
outputting a reproduced image as a hard copy from a printer 
by reading a color image with a scanner to obtain input image 
data and by carrying out a desired kind of image processing 
JflO on the input image data has been put into practice (Japanese 

Unexamined Patent Publication No. 1 1 ( 1 9 9 9 ) - 2 3 4 5 2 3 , for 
example) . In such a system, the input image data are converted 
from RGB color signals into CMYK dot% signals. First, a tone 
^ curve and a color correction amount used in a color correction 

15 unit are determined for the input image data, and a 

i == t 

three-dimensional look-up table (hereinafter called 3DLUT) 

r— 

for converting the input image data into output image data 
is generated based on the tone curve and the color correction 
amount. The RGB color signals of the image data are converted 
20 into the CMYK dot% signals of the output image data by 

interpolating the 3DLUT. Printing is carried out by 
controlling an amount of ink for each color using the dot% 
s ignal s . 

As has been described above, when image data obtained 
25 by a digital camera are output, tone correction processing 

and color correction processing is also carried out. 
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High-quality images are also expected in this case, by setting 
conditions for the tone correction processing and the color 
correction processing for each image, as in the system for 
printing . 

5 Meanwhile, preference for a specific target in a printed 

image varies . Especially, preference for reproduction of skin 
color and gray varies between Japan and the Unites States or 
Europe . Therefore , conditions for tone correction processing, 
color correction processing, and the like need to be changed 

O 

*=10 as desired in some cases. Furthermore, adjustment of 

«P correction processing conditions for tones, density, and 

]£ colors for a specific model of a digital camera is desired 

^ separately from adjustment of the above processing conditions 

y that are common among digital cameras so that a desired kind 

*~15 of image processing can be carried out on image data obtained 

by the digital camera. 

SUMMARY OF THE INVENTION 
The present invention has been conceived based on 
consideration of the problems described above. An object of 
20 the present invention is therefore to provide an image 

processing condition setting method for flexibly and 
conveniently carrying out processing such as tone correction, 
density correction, and color correction on image data obtained 
by a digital camera, and to provide an image processing method, 
25 an image processing apparatus, and a computer - readable 

recording medium storing a program to cause a computer to 
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execute the image processing method. 

An image processing method of the present invention is 
a method for obtaining processed image data by carrying out 
image processing on image data obtained by a digital camera, 
according to default processing conditions and processing 
conditions corresponding to a model of the digital camera. 
The image processing method comprises the step of customizing 
the default processing conditions and/or the processing 
conditions corresponding to the model of the digital camera. 

The "default processing conditions" refer to image 
processing conditions set in common for all models of digital 
camera, regardless of a model of each digital camera. More 
specifically, the default processing conditions refer to tone 
correction conditions, density correction conditions, color 
correction conditions (hereinafter, respectively called 
reference tone correction conditions, reference density 
correction conditions, and reference color correction 
conditions) and a gain of sharpness processing, for example. 

The "processing conditions corresponding to a model of 
the digital camera" refer to processing conditions for 
correcting characteristics peculiar to the model of the digital 
camera (hereinafter called model processing conditions) , such 
as tone characteristics, density characteristics, or color 
characteristics of the digital camera represented in the image 
data obtained by the digital camera (hereinafter respectively 
called model tone characteristics, model density 



characteristics, and model color characteristics). More 
specifically, the model processing conditions refer to model 
tone curves for correcting the model tone characteristics of 
the digital camera , mode 1 density correction value s , and model 
color correction parameters. 

It is preferable for the model processing conditions 
to include at least one of tone correction processing 
conditions, density correction processing conditions, and 
color correction processing conditions, each corresponding 
to the model of the digital camera. 

It is also preferable for operation by an operator to 
be eased by customizing the default processing conditions 
through generation of customized default processing condition 
menus in advance and selection of a desired one of the cus tomi zed 
default processing condition menus. 

Likewise, it is also preferable for the operation to 
be easedby cus tomi z ing the model processing conditions through 
generation of customized model processing condi t ion_menus in 
advance and selection of a desired one of the customized model 
processing condition menus. 

An image processing apparatus of the present invention 
is an apparatus for obtaining processed image data by carrying 
out image processing on image data obtained by a digital camera , 
according to default processing conditions and processing 
conditions corresponding to a model of the digital camera. 
The image processing apparatus comprises: 




default processing condition setting means for 
customizing the default processing conditions; 

model processing condition setting means for customizing 
the processing conditions corresponding to the model of the 
digital camera; and 

image processing means for carrying out the image 
processing based on the default processing conditions set by 
the default processing condition setting means and the 
processing condi t ions corresponding to the model of the digital 
camera set by the model processing condition setting means. 

The image processing apparatus of the present invention 
may further comprise: 

processing condition management means for providing a 
name to the default processing conditions set by the default 
processing condition setting means and/ or the model processing 
condi tions set by the model processing condi t ion setting means , 
and for storing the default processing conditions and/or the 
model processing conditions in relation to the name thereof; 
and 

processing condition reading means for reading the 
default processing conditions and/or the model processing 
conditions managed by the processing condition management 
means and for providing the conditions that have been read 
into the image processing means. 

The "name" herein referred to can be any identifier 
enabling identification of the default processing conditions 



3EJ 



set by the default processing condition setting means and/or 
the model processing conditions set by the model processing 
condition setting means upon storing and managing the 
conditions. The name can be given to the default processing 
5 conditions or the model processing conditions separately from 

each other, or to a set of the default processing conditions 
and the model processing conditions. The name can be a simple 
management number for the processing conditions. However, 
for the sake of easy user management and easy use, it is 
iplO preferable for the name to contain information about a person 

s ¥* who requested printing (or a photographer) and information 

of a photographing condition, such as "cloudy-weather 
^ conditions for digital camera X of user A". 

■= It is preferable for the model processing condition 

f^l5 setting means to customize at least one of tone correction 

|» processing conditions, density correction processing 

conditions, and color correction processing conditions each 
corresponding to the model of the digital camera. 

It is also preferable for the default processing 
20 condition setting means to set the default processing 

conditions through selection from customized default 
processing condition menus generated in advance, in order to 
ease operation by an operator. 

Likewise, it is also preferable for the model processing 
25 condition setting means to set the processing conditions 

corresponding to the model of the digital camera through 
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selection from customized model processing condition menus 
generated in advance, in order to ease operation by the 
operator . 

The image processing method of the present invention 
5 may be provided as a computer - readabl e recording medium storing 

a program to cause a computer to execute the image processing 
method. 

The present invention also provides an image processing 
condition setting method for setting image processing 
*J3lO conditions for image data obtained by a digital camera. The 

:j~ image processing condition setting method comprises the step 

;~ of customizing default processing conditions and/or 

^ processing conditions corresponding to a model of the digital 

^ camera . 

=~15 According to the present invention, customization of 

!H the default processing conditions and/or the model processing 

conditions is possible when the image processing is carried 
out on the image data obtained by the digital camera according 
to the default processing conditions and the processing 
20 conditions corresponding to the model of the digital camera. 

Therefore , a user can reflect his/her preference for a specific 
target, and flexible image processing becomes possible. 

Furthermore, since the processing conditions can be 
customized for a digital camera of each specific model, image 
2 5 processing on image data obtained by a digital camera of another 

model is not affected, and the image processing can be freely 
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adjusted for the camera of the specific model. 

Moreover, the customized default processing condition 
menus and the customized model processing condition menus are 
generated in advance for setting the default processing 
conditions and the model processing conditions. By setting 
the default processing conditions and the model processing 
conditions as desired through selection from these menus, 
operation by an operator becomes easy and convenient, which 
leads to efficient image processing. 

If the image processing apparatus of the present 
invention comprises the processing condition management means 
for managing the customized default processing conditions 
and/or the customized model processing conditions in relation 
to the name thereof and the processing condition reading means 
for reading the customized default processing conditions 
and/or the customized model processing conditions managed by 
the processing condition management means and for providing 
the conditions that have been read to the image processing 
means, only the processing conditions need to be read when 
image data having the same photographing condition are 
processed. Therefore , settingtheprocessing condi t ions each 
time becomes unnecessary, which is efficient. If the name 
has the information of the person who requested printing (or 
the photographer) and the information of the photographing 
condition, the name is useful for user management and improves 
convenience . 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block diagram showing a configuration of 
an image processing apparatus as an embodiment of the present 
invention; 

Figure 2 is a block diagram showing a configuration of 
image processing condition determining means; 

Figure 3A and Figure 3B respectively show examples of 
a reference tone setting menu and a model tone setting menu; 

Figure 4 is a diagram explaining setting of a tone 
conversion table; 

Figure 5A and Figure 5B respectively show examples of 
reference color correction conditions and model color 
correction conditions ; 

Figure 6 is a diagram showing an example of an intensity 
function; 

Figure 7 is a diagram showing an example of an intensity 
function for skin color; 

Figure 8 shows a sharpness gain setting menu; and 

Figure 9 is a flow chart showing operation of the image 
processing apparatus in the embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Hereinafter, an embodiment of the present invention will 
be explained with reference to the accompanying drawings. 

Figure 1 is a block diagram showing a configuration of 
an image processing apparatus as the embodiment of the present 
invention . As shown in Figure 1, an image processing apparatus 
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1 in this embodiment comprises reading means 3 for reading 
image data SO comprising color data RO, BO, and GO from a memory 
card 2 storing the image data SO obtained by photographing 
a subject by a digital camera, index image generating means 
5 4 for generating index image data Sll representing index images 

by reducing the image data SO, setting information generating 
means 5 for generating setting information HO necessary for 
setting tone conversion tables TO, which will be explained 
later by analyzing the image data SO, image processing 
'JrlO condition determining means 6 for carrying out tone conversion 

!|! processing and color correction processing on the index image 

]j1 data Sll and for setting image processing conditions used for 

iy 

3 ^ carrying out the tone conversion processing and the color 

a j 

*S correction processing on the image data SO upon printing the 

!/Jl5 image data SO, a monitor 7 for displaying index images 

r7 represented by index image data Sll ' after the tone conversion 

processing and the color correction processing, input means 
8 for carrying out various kinds of input to the image processing 
condition determining means 6 , DCMY keys 9 for changing density, 
20 processing means 10 for obtaining converted image data S12 

by converting the image data SO according to the image 
processing conditions set by the image processing condition 
determining means 6, reduction means 11 for obtaining reduced 
image data SO' by reducing the image data SO in the case where 
25 the number of pixels for an image represented by the image 

data SO is larger than the number of pixels for printing the 
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image, enlargement means 12 for obtaining enlarged image data 
S12 ' by enlarging the converted image data S12 in the case 
where the number of the pixels is equal to or smaller than 
the number of the pixels for printing, sharpness processing 
means 13 for obtaining processed image data S13 by carrying 
out sharpness processing on the converted image data S12 or 
on the enlarged image data S12 ' , and a printer 14 for obtaining 
a print P by outputting the processed image data S13 . 

The reading means 3 comprises a card reader and the like 
for reading the image data SO from the memory card 2 . Since 
the image data read from the memory card 2 are generally 
compressed, the image data SO are obtained by decompressing 
the image data read from the memory card. Information 
indicating a model of the digital camera that obtained the 
image data SO (hereinafter called camera model information) 
is added to the image data SO as tag information of the image 
data. Therefore, the camera model information is also read. 
As a standard for recording the camera model information as 
the tag information, "Baseline TIFF Rev. 6.0 RGB Full Color 
Image" adopted as a non - compr e s s ed file format of an Exif file 
can be used, for example. 

The index image generating means 4 reduces the image 
data SO by thinning or the like, and generates the index image 
data Sll. 

The setting information generating means 5 generates 
the setting information HO in the followingmanner. In general, 
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automatic exposure control processing (AE processing) and 
automatic white balance processing (AWB processing is carried 
out in a digital camera for reproduction of image data on a 
monitor. However, in the case where the image data are 
5 reproduced by a printer, the AE processing and the AWB 

processing (hereinafter called AE/ AWB processing) carried out 
in the digital camera is not sufficient. Therefore, AE/AWB 
processing appropriate for the printer is necessary. The 
setting information generating means 5 estimates a correction 

^10 amount necessary for AE/AWB processing optimal for printing 

OS 

'fr for each of RGB color signals comprising the image data SO 

!y 

% ^ (or the image data SO' in the case where the image data SO 

vu 

= ^ have been reduced by the reduction means 11) . The correction 

^ amount is included in the setting information HO. For this 

15 reason, an average of each of the RGB color signals comprising 

I s ** the image data SO is found as described in Japanese Unexamined 

3 

Patent Publication No. 1 1 ( 1 9 9 9 ) - 2 2 0 6 1 9 for example, and a 
correction value is determined so that the average becomes 
a target value for printing. The correction value is included 

20 inthesetting information HO and output . The correction value 

includes the correction amount for exposure and white balance. 

The setting information generating means 5 finds 
correction amounts used for correcting highlight and shadow 
of tones into nonlinear forms when the image processing 

25 conditions are set by the image processing condition 

determining means 6 as will be explained later. These 



13 



correction amounts are also included in the setting information 
HO. A printer generally has a narrow density reproduction 
range and colors easily become evenly bright in a highlight 
area and evenly dark in a shadow area of an image. Therefore, 
5 as described in Japanese Unexamined Patent Publication No. 

11 (1999) - 331596 , the setting information generating means 5 
finds the correction amounts to harden tones of the highlight 
area and soften tones of the shadow area in a density space, 
in the case where density of a print increases by the AE 

o 

CflO processing or the AWB processing. On the other hand, in the 

=P case where the density decreases in the print, the setting 

i hj 

^3 information generating means 5 finds the correction amounts 

i% i 

fy so that the tones of the highlight area are softened and the 

Q tones of the shadow area are hardened. The correction amounts 

^15 are also included in the setting information HO. 
O The setting information generating means 5 reads the 

a i a 
3 — 

tag information of the image data SO. The camera model 
information of the tag information and the number of the pixels 
(hereinafter called YO) in the image represented by the image 

20 data SO (or the number of pixels in a reduced image SO' 

(hereinafter called YO ' ) in the case where the image data SO 
have been reduced by the reduction means 11) are included in 
the setting information HO . 

The monitor 7 displays the index images represented by 

25 the index image data Sll ' . At the time of correcting tone 

curves and color correction conditions that will be explained 
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later, the tone curves and the color correction conditions 
arealsodisplayedon the moni tor together with the index images 
In this embodiment, the number of index images displayed 
simultaneously is six. 

The input means 8 comprises a keyboard, a mouse and the 
like for carrying out various kinds of input to the image 
processing condition determining means 6 . A type of reference 
tone used at the time of setting the image processing conditions 
(hereinafter called reference tones) is input from the input 
means 8. The reference tones refer to tones for carrying out 
the tone conversion processing on the image data to obtain 
the print P having appropriate tones when printing is carried 
out by the printer 14. As the reference tones, tones for a 
standard situation, tones for cloudy weather, tones for 
backlight, and tones for flash photographing are available. 
By inputting one of the types of these reference tones selected 
by using the input means 8, a menu for setting the reference 
tones corresponding to the selection is displayed. From the 
reference tone setting menu, reference tone correction curves 
representing reference tone correction processing conditions 
are set by the image processing condition determining means 
6 . For example, in the case where the tones for cloudy weather 
are selected, a reference tone setting menu for cloudy weather 
is displayed. Figure 3A shows an example of the reference 
tone setting menu. As shown in Figure 3A, the reference tone 
correction processing conditions comprise a reference tone 
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correction curve C100 corresponding to the entire RGB colors, 
and reference tone correction curves C110, C120, and C130 for 
R , G, and B, respectively. By correcting the curve C100 as 
desired by using the reference tone setting menu shown in Figure 
3A with the input means 8, the reference tone correction curve 
can be set as desired for the entire RGB colors. Likewise, 
by correcting C110 , C12 0 or C130 , the reference tone correction 
curve for R, G, or B can be set as desired. By correcting 
the reference tone correction curves C110, C120 and C130, 
density and gray balance can also be adjusted. 

The DCMY keys 9 comprise four keys for correcting density 
D of an entire image and densities of cyan (C) , magenta (M) 
and yellow (Y) , respectively. Depending on how many times 
each of these keys is pressed down, the density of the entire 
image or each of the colors can be changed by the image processing 
condition determining means 6. The correction of the 
reference tone curves C100, C110, C120, and C130 input from 
the input means 8 and the change of the densities input from 
the DCMY keys 9 are reflected in the index images displayed 
on the monitor 7 in real time. 

The image processing condition determining means 6 
outputs to the processing means 10 either the image processing 
conditions as they are, or a 3DLUT generated therein based 
on the image processing conditions, depending on the number 
Y0 (or Y0 ' ) of pixels in the image represented by the image 
data SO (or SO') included in the setting information HO for 
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setting the image processing conditions used for carrying out 
the tone conversion processing and the color correction 
processing on the image data SO (or SO') . When the image 
processing is carried out on the image data, the image 
processing is generally carried out on each of the pixels by 
using the image processing conditions that have been determined , 
or by generating the 3DLUT based on the image processing 
conditions that have been determined. In the image output 
apparatus in this embodiment, the image processing condition 
determining means 6 compares the number YO (or YO ' ) of the 
pixels of the image represented by the image data SO (or SO') 
with the number of lattice points in the 3DLUT, in order to 
shorten processing time. In the case where the number YO (or 
YO') of the pixels is larger than the number of lattice points, 
the 3DLUT is generated and output to the processing means 10. 
On the other hand, if the number YO (or YO ' ) of the pixels 
is equal to or smaller than the number of lattice points, the 
image processing conditions are output to the processing means 
10 as they are, and the 3DLUT is not generated. Hereinafter, 
the image processing condition determining means 6 will be 
explained in detail, with reference to Figure 2. 

Figure 2 is a block diagram showing a configuration of 
the image processing condition determining means 6. In the 
case where the image data SO comprise the RGB color data having 
8bits each, 256 3 datawillbenecessaryifa 3DLUT for converting 
all the data is generated. Consequently, generation of such 
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a 3DLUT becomes time - consuming . Therefore, in this embodiment, 
the number of bits of the color data RO, GO, and BO is reduced 
to generate the 3DLUT having 33 data for each of the RGB colors, 
namely, 0, 7, 15, 247, and 255. In other words, in this 

5 embodiment, the number of lattice points in the 3DLUT is (2 n /8 + l) 

where n is the number of output bits of the image data SO. 

As shown in Figure 2, the image processing condition 
determining means 6 comprises logarithmic conversion means 
_ 21 for obtaining image data SI by carrying out logarithmic 

^10 conversion on an t i logar i thms RO ' , GO ' , and BO ' found from the 

3 *r image data SO or the image data SO' having the reduced number 

If 

^ of bits according to ITU-R BT.709 (a standard for 8-bit data: 

fy 

= y REC . 709) for example by using Equations ( 1 ) - ( 3 ) below, tone 

si 

^ conversion means 22 for obtaining image data S2 by carrying 

|^15 out tone conversion processing on the image data SI, tone 

'si 

H setting means 23 for setting the tone conversion tables TO 

used for the tone conversion by the tone conversion means 22, 
a memory 24 storing a plural ity of reference tone setting menus , 
model tone setting menus corresponding to models of digital 

20 cameras, and customized tone processing condition menus 

(customized model tone processing conditions and customized 
reference tone processing conditions) set for respective users 
as will be explained later, inverse logarithmic conversion 
means 25 for obtaining image data S3 comprising color data 

25 R3 , G3 , and B3 by carrying out inverse logarithmic conversion 

on the image data S2, LCH conversion means 26 for converting 
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the color data R3 , G3 , and B3 comprising the image data S3 
into data L3, C3 and H3 representing lightness L*, chroma C*, 
and hue angle HA, color correction means 27 for obtaining color 
corrected data L4 , C4, and H4 by carrying out color correction 
processing on the data L3 , C3 , and H3 , s RGB conversion means 
28 for obtaining color corrected image data S4 comprising color 
data R4, G4 , and B4 by converting the color corrected data 
L4 , C4 and H4 into an sRGB color space which is a color space 
for monitor display, printing conversion means 2 9 for obtaining 
print image data S5 by converting the color corrected image 
data S4 into a color space for printing, LUT generating means 
30 for generating the 3DLUT based on the image data SO and 
the print image data S5, and processing method determining 
means 33 for determining whether the image processing 
conditions or the 3DLUT is output to the processing meanslO. 
The color correction means 27 is connected to color correction 
condition setting means 32 for setting the color correction 
conditions used by the color correction means 27. The color 
correction condition setting means 32 reads the color 
correction conditions from a memory 31 storing a plurality 
of reference color correction condition setting menus, model 
color correction condition setting menus corresponding to 
models of digital cameras, and customized color correction 
condition menus (customized model color correction condition 
menus and customized reference color correction condition 
menus set for respective users as will be explained later) , 
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based on the setting information HO and an input from the input 
means 8. The color correction condition setting means 32 
customizes the color correction conditions if necessary, and 
inputs the color correction conditions to the color correction 

RO/255 

GO/255 (1) 
BO/255 

( (Pr + 0 . 099) /l . 099) 2 222 

( (Pg + 0 . 099) /l . 099 ) 2 222 (if Pr, Pg, Pb^0.081) 
((Pb + 0 . 099) /l . 099) 2 222 (2) 

Pr/4 . 5 

Pg/4.5 (if Pr, Pg, Pb < 0.081) (3) 

Pb/4 . 5 

For the image data SO or SO' whose number of bits is 
9 or larger, the logarithmic conversion means 21 obtains the 
anti logari thms R0 ' , GO', and B0' according to Equations (1') 
20 to (3) below, and obtains the image data SI by carrying out 

logarithmic conversion thereon: 

Pr = R0/(2 n -l) 

Pg = GO/ (2 n - 1) (1 ' ) 

Pb = B0/ (2 n - 1) 

25 

R0' =((Pr + 0 . 099) /l . 099 ) 2 222 



means 27 
Pr 
Pg 
Pb 



*fel0 R0 ' 

m 

;P GO ' 

B0 ' 

W 
III 



R0 ' 



^15 GO 



B0 
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GO' = ((Pg + 0 . 099) /l . 099 ) 2 222 (if Pr, Pg, Pb^0.081) 
BO' =((Pb + 0 . 099) / I . 099 ) 2,222 (2) 



RO' = Pr/4.5 

5 GO' = Pg/4.5 (if Pr, Pg, Pb < 0.081) (3) 

BO' = Pb/4.5 

where n is the number of bits of the image data SO or 

SO ' . 

_ As has been described above, the memory 24 stores the 

•SlO menus for setting the reference tones for the standard 

IS 

a j~ situation, cloudy weather , backlight, and flash photographing , 

^ as well as the model tone setting menus corresponding to models 

S^f I 
3 3 1 
S ~ 

of digital camera, in addition to the customized tone 
y processing condition menus set for respective users (the 

5^ : 

jj^lS customized model tone processing conditions and the customized 

™ reference tone processing conditions) . Figure 3B shows an 

example of the model tone setting menus. As shown in Figure 
3B, model tone processing conditions for a digital camera A 
comprise a model tone correction curve C200 for correcting 
20 a tone characteristic of the model for all RGB colors, and 

model tone correction curves C210, C220, and C230 for 
correcting tone characteristics of the model for R, G, and 
B, respectively. As in the case of customizing the reference 
tone curves described above, the model tone correction curve 
25 for all RGB colors, R only, G only, or B only can be set as 

desired by correcting the curve C200, C210, C220, or C230 in 



21 



the model tone setting menu shown in Figure 3B by using the 
input means 8. Adjustment of density and gray balance can 
also be achieved by correcting the model tone correction curves 
C210, C220 and C230 for R, G, and B, respectively. 
5 The tone conversion tables TO are set in the tone setting 

means 23 for converting tones of the image data SI in the 
following manner. Figure 4 is a diagram for explaining how 
the tone conversion tables TO are set. The tone conversion 
tables TO generate the color data R2 , G2 , and B2 comprising 

l=! 

'f=JlO the image data S2 by the tone conversion of the color data 

\h ri, Gl, and Bl comprising the image data SI according to first 

^3 to fourth quadrants in Figure 4 . In the tone setting means 

^ 23, the tone conversion tables TO are set for R, G, and B. 

^ First, the setting information HO is input to the tone setting 

f^l5 means 23 , and one of the model tone setting menus corresponding 

^ to the model of the digital camera is read from the memory 

24 based on information on the model of the digital camera 
included in the setting information HO. Meanwhile, the 
reference tone setting menu for the standard situation is read 
20 from the memory 24 as a default of the reference tone setting 

menu. However, if reading the reference tone setting menu 
for cloudy weather or for backlight or for flash photographing 
is instructed from the input means 8, the corresponding menu 
is read from the memory 24. 
25 A model tone correction curve CI for correcting the model 

tone characteristics of the digital camera is set in the first 
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quadrant, as shown in Figure 4 . Since a quality of a reproduced 
image varies depending on a model or a manufacturer of a digital 
camera, the model tone correction curve CI corrects the tone 
characteristics of the individual camera in order to obtain 
5 images of uniform quality regardless of the model thereof. 

As in the example of the model tone setting menu shown in Figure 
3B, the default model tone correction curves C200, C210, C220, 
and C230 have been generated corresponding to the model of 
the digital camera in order to absorb the model tone 
characteristics of the digital camera, and the model tone 
*f! correction curve obtained by correcting (customizing) the 

_r ( model tone correction curves as desired is used as the model 

- 5 * 
; t~ 

5 = : 

] v tone correction curve CI. In the case where gray balance is 

not changed, the same model tone correction curve CI is used 

lii 

:~:15 for the respectxve RGB colors. However, if the gray balance 

P is changed, the model tone correction curve CI becomes 

different for each of the RGB colors. By converting the color 
data Rl, Gl and Bl based on the tone curve CI, a logarithmic 
exposure value compensating the tone characteristics of the 
20 camera can be obtained. 

A line C2 for correcting exposure is set in the second 
quadrant. The line C2 for exposure correction is basically 
a line passing through the origin. By translating the line 
C2 in directions shown by an arrow A based on the correction 
25 amount for white balance and exposure included in the setting 

information HO, the exposure is corrected. Data representing 
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reflection density of the subject on which the AE/AWB 
processing appropriate for printing has been carried out can 
be obtained by the line C2 . 

A reference tone correction curve C3 is set in the third 
quadrant. The reference tone correction curve C3 is set in 
the following manner. In the reference tone setting menu that 
has been read as shown in Figure 3A, the reference tone 
correction curves C100, C110, C120, and C130 are corrected 
as desired by using the input means 8, and the reference tone 
correction curve obtained by this correction is set as the 
reference tone correction curve C3 . As in the case of the 
model tone correction curve CI described above, the same 
reference tone correction curve C3 is used for the RGB colors 
in the case where the gray balance is not changed. If the 
gray balance is changed, the reference tone correction curve 
C3 becomes different for each of the RGB colors. Inthis example, 
the reference tone correction curve C3 for the standard 
situation is set. The reference tone correction curve C3 has 
an "S" -like shape and a middle portion thereof corresponds 
to the case of 7 =1.6. In this embodiment, the conversion 
by the reference tone correction curve C3 is called 7 
conversion. By using the tone curve C3, density data 
appropriate for printing can be obtained. 

A tone curve C4 for correcting tones of the highlight 
area and the shadow area of the image to become nonlinear is 
set in the fourth quadrant. Correction amounts for the tone 



24 



curve C4 are determined by the correction amounts of the 
highlight area and the shadow area included in the setting 
information HO. By using the tone curve C4 , the color data 
R2 , G2 and B2 comprising the image data S2 can be obtained. 

The tone conversion tables TO are changed by an input 
from the input means 8 or from the DCMY keys 9. CM, and 
Y of the index images shown on the monitor 7 change by pressing 
down the DCMY keys 9. The changes in C, M , and Y are converted 
into the changes of densities of R, G, and B, and the tone 
conversion tables TO are changed according to the changes in 
the densities. In other words, the changes of RGB density 
are predetermined depending on how many times the DCMY keys 
9 are hit, and the densities are changed according to pressing 
of the DCMY keys 9. More specifically, by translating the 
line C2 in the directions shown by the arrow A in the second 
quadrant based on how many times the DCMY keys are hit, the 
densities of R, G, and B are changed. Since the model tone 
correction curves and/or the reference tone correction curves 
are customized by the input from the input means 8, the curve 
CI in the first quadrant or the curve C3 in the third quadrant 
is changed. By changing the line C2 and the curves CI and 
C3, the tone conversion tables TO are set. The corrected 
(customized) model tone correction curves and the customized 
reference tone correction curves are stored in the memory 24 
as " cloudy - weather reference tone correction curves for user 
A" or "cloudy- weather model tone correction curves for a 



25 



digital camera X of user A", for example. 

The tone conversion means 22 obtains the image data S2 
by converting the image data SI based on the tone conversion 
tables TO set by the tone setting means 23. 

Processing in the logarithmic conversion means 21, the 
tone conversion means 22, and the inverse logarithmic 
conversion means 25 is carried out in an RGB color space. 

The LCH conversion means 26 converts the image data S3 
from the RGB color space into an L*a*b* color space, and obtains 
the data L3, C3, and H3 representing the lightness L* , the 
chroma C*, and the hue angle HA . Hereinafter, thi s conver s ion 
will be explained. Since the image data SO obtained by the 
digital camera are according to ITU-R BT.709 (REC 709), the 
color data R3 , G3 , and B3 comprising the image data S3 are 
converted into CIE1931 tristimulus values X, Y, and Z based 
on the following Equation (4) : 

X R3 

Y = |A| G3 (4) 
Z B3 

Here, the matrix |A| is a matrix for converting the color data 
R3, G3, and B3 into the tristimulus values X, Y, and Z, and 
the following values can be used, for example: 

0 . 4124 0 . 3576 0 . 1805 
|A| = 0.2126 0.7152 0.0722 (5) 

0.0193 0.1192 1. 0571 
Instead of the matrix |A| , a look-up table may be used to find 
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the tristimulus values X, Y, and Z. 

CIE1976 L* (=L3) , C* (=C3) , and HA (=H3) are found from 
the tristimulus values X, Y, and Z, based on Equations (6) - (8) 
below: 

5 a* - 500 {f (X/Xn) -f (Y/Yn) } 

b* = 200 {f (Y/Yn) - f (Z/Zn) } (6) 
L* = 116 (Y/Yn) 1/3 - 16 (if Y/Yn > 0.008856) 

L* = 903.25(Y/Yn) (if Y/Yn ^ 0.008856) 

If X/Xn, Y/Yn, Z/Zn > 0.008856, 
|l0 f (a/an) » (a/an) 1/3 (a = X, Y, Z) 

If X/Xn, Y/Yn, Z/Zn ^ 0.008856, 

f (a/an) = 7.787(a/an) + 16/116 

II \ 

Xn, Yn , and Zn are tristimulus values for white and can be 
"£ substituted by tristimulus values corresponding to CIE-D65 

5*3 : 

:^15 (a light source whose color temperature is 6500 K) . 

H C* = (a* 2 + b* 2 ) 1/2 (7) 

HA - tan' 1 (b*/a*) (8) 

The color correction means 27 corrects lightness, chroma 
and hue for eleven colors, namely R, G, B, C, M, Y, YellowGreen 
20 (YG) , BlueSky (BS) , a skin color SK(HL) in the highlight area, 

a skin color SK(MD) having an intermediate density, and a skin 
color SK(SD) in the shadow area. More specifically, the 
corrected data L4 , C4 , and H4 are obtained by correcting the 
data L3, C3 and H3 according to Equations (9) -(11) below: 
25 L4 - L3 - Al 

Al = ELPi Wi + ELPj Wj + Al Wj (9) 
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C4 



C3 - Ac 



Ac 



= Zcpi wi + Zcpj wj + Ac wj 



(10) 



H4 = H3 



- Ah 



Ah = ZHPi wi + EHPj wj + Ah 



WJ 



(ID 



where i: R, G, B, C, M, Y, YG , BS , 
j: SK(HL), SK(MD), SK(SD), 

LPi, LPj: correction degrees in the lightness, 
CPi, CPj : correction degrees in the chroma, 
HPi, HPj : correction degrees in the hue, 
Wi, Wj : intensity functions, 

Al: a lightness change caused by tone correction, 
Ac: a chroma change caused by tone correction, and 
Ah: a hue change caused by tone correction. 
The lightness correction degrees LPi and LPj , the chroma 
correction degrees CPi and CPj , and the hue correction degrees 
HPi and HPj are provided by the color correction condition 
setting means 32. The color correction condition setting 
means 32 reads a desired one of the reference color correction 
condition menus (or the customized reference color correction 
condition menus set for respective users) and one of the model 
color correction condition menus corresponding to the model 
of the digital camera (or the customized model color correction 
condition menus set for respective users) from the memory 31. 
If necessary, the color correction condition setting means 
32 selects and customizes the color correction conditions 
included in the menus that have been read. When the setting 
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information HO is input to the color correction condition 
setting means 32, the model color correction condition setting 
menu corresponding to the model of the digital camera is read 
from the memory 31 based on the information on the model of 
the digital camera included in the setting information HO. 
The model color correction condition setting menu has a 
plurality of model color correction conditions as shown Figure 
5B, for example. As shown in Figure 5B, the model color 
correction conditions comprise color correction parameters 
corresponding to the model of the digital camera, for R, G, 
B, C, M, Y, YG, BS, SK(HL), S K ( MD ) , and SK(SD) . By selecting 
a desired one of the model color correction conditions from 
the model color correction condition setting menu for the 
specific model and by correcting (customizing) the selected 
condition by using the input means 8, the color correction 
parameters can be set for the model as desired. Meanwhile, 
a reference color correction condition setting menu for the 
standard situation is read from the memory 31 as a default 
menu. In the case where reading a reference color correction 
condi t ion setting menu for cloudy weather or backlight or flash 
photographing is specified by the input means 8, a color 
correction condition setting menu therefor is read from the 
memory 31. The reference color correction condition setting 
menu has a plurality of reference color correction conditions . 
Figure 5A shows an example of the reference color correction 
conditions. As shown in Figure 5A, the reference color 
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correction conditions comprise color correction parameters 
for R, G, B, C, M, Y , YG , BS, SK(HL), SK(MD), and SK(SD) that 
are common among all models of digital camera. By selecting 
a desired one of the reference color correction conditions 
5 from the reference color correction condition menu and by 

correcting (customizing) the selected condition by using the 
input means 8, the reference color correction condition 
parameters can be set as desired. The customized reference 
color correction conditions and the customized model color 
!_%0 correction conditions are stored in the memory 31 as "a 

cloudy - weather reference color correction condition menu for 
user A" and " cloudy -weather model color correction condition 
menu for digital camera X of user A", for example. When one 
of the customized color correction condition menus is selected 



-^15 by the input means 8, the corresponding customized reference 

color correction conditions and the corresponding customized 
model color correction conditions are read from the memory 
31 and input to the color correction means 27. 

Since values representing how much the lightness, the 
20 chroma and the hue need to be changed are set in the reference 

color correction condition menu (or the customized reference 
color correction condition menu) and the model color correction 
condi t ion menu (or the cus tomi zed model color correc t ion 
condition menu) that have been read, the color correction means 
25 27 sets the lightness correction degrees LPi and LPj , the chroma 

correction degrees CPi and CPj , and the hue correction degrees 
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HPi and HPj in Equations (9) -(11) according to the values set 
by the color correction condition setting means 32. Each of 
the correction degrees of each color is obtained as a sum of 
the corresponding values in the reference color correction 
condition menu and the model color correction condition menu. 

The intensity functions are found according to Equation 
(12) below: 

Wi = F(d) 

d = ( ( L i - L3 ) 2 + (Ci-C3) 2 + (Hi -H3) 2 ) ) 1/2 (12) 
Li, Ci, and Hi are center colors of R, G, B, C, M, Y , YG , and 
BS . For R, G, B, C, M , and Y, the center colors Li, Ci, and 
Hi refer to colorimetric values of these colors of Macbeth 
Color Checker registered by Macbeth A Division of Kallmorgen 
Co. For YG and BS, the center colors Li, Ci and Hi refer to 
average colorimetric values of vegetation and sky in an image 
represented by the image data SO. F(d) is a function such 
that the function is constant up to a predetermined value (30 
in this example) of distance d between each of the center colors 
Li, Ci, and Hi and the data L3 , C3 , and H3 , and decreases if 
d becomes larger than the predetermined value, as shown in 
Figure 6 . 

Meanwhile, statistical distribution ranges of the skin 
colors SK(HL), SK(MD) and SK(SD) of the image represented by 
the image data SO in an L*a*b* color space are found. The 
skin color function W(j) [O^Wj^Sl] whose value is small in 
a peripheral area and large at a center area is set in the 
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distributions, as shown in Figure 7. 

A 1 , Ac, and Ah represent how much the lightness, chroma , 
and the hue of the skin colors are changed according to the 
nonlinear tone correction set in the fourth quadrant in Figure 
5 4, and are found in the following manner. Based on the RGB 

values of the image data after the 7 conversion in the third 
quadrant and based on the RGB values (R2, G2 , B2) of the image 
data after the nonlinear tone correction in the fourth quadrant, 
^ Al*, Ac*, and Aha representing how much the lightness L*, 

:j£LO the chroma C*, and the hue angle HA are changed before and 

:f! after the nonlinear tone correction are found according 

J- Equations (4) - (8) . Al*, Ac*, and A HA are mul t ipl ied by the 

§=§ i 

=~ intensity function Wj shown in Figure 7 as in Equations 

^ (13)~(15) below, to obtain Al, Ac, and Ah: 

:Jjl5 Al = Al* X wj (13) 

H Ac = Ac* X wj (14) 

Ah = Aha X wj (15) 

The sRGB conversion means 28 finds a* and b* after the 
correction by solving Equations (7) and (8) by using the 
20 corrected data L4 , C4 and H4 . The s RGB conversion means 28 

then finds tristimulus values X5 , Y5 , and Z5 after the 
correction by solving Equation (6) by using a*, b* after the 
correction and by using L* . The tristimulus values X5, Y5 , 
and Z5 are then converted into the color data R4 ' , G4 ' and 
25 B4 ' according to Equation (16) below: 

R4 ' X5 
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G4 ' = | A | 1 Y5 (16) 
B4 ' Z5 

The color data R4 , G4 , and B4 are then found by using the 
following Equation (17), and the data are used as the color 
corrected image data S4 in the sRGB color space for monitor 
di splay : 

R4 - 255X (1.055R4' 1 0/2 - 4 - 0.055 ) 

G4 = 255X (1 . 055G4 ' 10/2 - 4 - 0 . 055 ) 

B4 = 255 X ( l . 055B4 ' 10/24 - 0 . 055) (if 0.00304 

^ R4 ' , G4 ' , B4 ' < 1) 

R4 = 255X12. 92R4' 

G4 = 255X12. 92G4' (if 0 ^ R4 ' , G4 ' , B4 ' < 0.00304) 
B4 = 255X12. 92B4' (17) 

The processing method determining means 33 calculates 
the number of lattice points of the 3DLUT used for the tone 
conversion and the color correction of the image data SO, by 
using the number of bits of the image data SO. The calculated 
number of lattice points of the 3DLUT is compared with the 
number Y0 (or the number Y0 ' in the case where the image data 
SO have been reduced) of pixels of the image represented by 
the image data SO. If the number of lattice points is equal 
to or larger than the number Y0 (or Y0 ' ) of pixels, the 3DLUT 
is not generated and the image processing conditions compr i s ing 
the tone conversion tables TO and the color correction 
conditions are output to the processing means 10 (the procedure 
shown by a dashed line) . On the other hand, if the number 
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of the lattice points is smaller than the number YO (or YO ' ) 
of the pixels, the procedure advances to processing to generate 
the 3DLUT (processing by the printing conversion means 29 and 
the LUT generating means 30) . 

The printing conversion means 29 obtains the print image 
data S5 by converting the color corrected image data S4 
according to a 3DLUT for converting the color corrected image 
data S4 in the sRGB color space into a color space for printing. 

The LUT generating means 30 finds a relationship between 
the color data R0, GO, and BO comprising the image data SO 
or the image data SO' (having the reduced number of bits) and 
the color data R5, G5 , and B5 comprising the print image data 
S5 for each of RGB colors, and uses the relationship as the 
3DLUT having 33 3 data to be output to the processing means 
10 . 

The index image data Sll are also input to the image 
processing condition determining means 6, and the tone 
conversion processing and the color correction processing is 
carried out thereon. The image data are converted into the 
s RGB color space by the sRGB conversion means 29, and output 
to the monitor 7 as the index image data Sll' after the tone 
conversion processing and the color correction processing. 

The 3DLUT or the image processing conditions are input 
from the 3DLUT generating means 6 in Figure 1 to the processing 
means 10. The processing means 10 converts the image data 
SO (or SO') to the converted image data S12 according to the 
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3DLUT if the 3DLUT is received. At this time, since the 3DLUT 
comprises the 33 3 data, color data comprising the converted 
image data S12 are found by volume interpolation or area 
interpolation of the 3DLUT, as has been described in Japanese 
Unexamined Patent Publication No. 2(1990) -87192, for example . 
On the other hand, if the processing means 10 receives the 
image processing conditions comprising the tone conversion 
tables TO and the color correction conditions, the tone 
conversion processing and the color correction processing is 
carried out on each of the pixels of the image data SO (or 
SO') by using the image processing conditions, and the 
converted image data S12 for printing are obtained. 

The number of pixels of the digital camera that obtained 
the image data SO varies, and may be smaller or larger than 
the number of pixels necessary for printing. Therefore, if 
the number of pixels of the image represented by the image 
data SO is equal to or larger than the number of pixels necessary 
for printing, the reduction means 11 reduces the image data 
SO and obtains the reduced image data SO' . The reduced image 
data SO' are converted into the converted image data S12 . On 
the other hand, if the number of pixels is smaller than the 
number of pixels necessary for printing, the converted image 
data S12 obtained by the processing means 10 are enlarged by 
the enlargement means 12 and the enlarged image data S12 ' are 
obtained . 

The sharpness processing means 13 carries out sharpness 
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processing on the converted image data S12, or on the enlarged 
image data S12' according to Equation (18) below, and obtains 
the processed image data S13 . In Equation (18) , the sharpness 
processing is carried out on the converted image data S12 . 
5 S13 = S12 + j3 (S12 - S12us) (18) 

where S12us is unsharp image data of the converted image data 
S12 and j3 is an enhancement factor. 

The enhancement factor j3 varying with a reduction ratio 
used by the reduction means 11 or with an enlargement ratio 
4o used by the enlargement means 12 is provided as shown in Figure 

8 so that the sharpness gain can be controlled as desired. 
J]3 As in the case of the tones and the colors, a reference gain 

^ and a gain depending on the model of the digital camera may 

•^j also be controlled. 

*t , 
=^15 Operation of the image processing apparatus an this 

'-. : 

embodiment will be explained next. Figure 9 is a flow chart 
showing the operation of the image processing apparatus in 
this embodiment. The image data SO obtained by photographing 
with the digital camera are read from the memory card 2 by 
20 the reading means 3 (Step SI) . The image data SO read from 

the memory card 2 are subjected to the reduction processing 
by the reduction means 11 if necessary. The index image 
generating means 4 generates the index image data Sll 
representing the index images of the image data SO (Step S2) , 
25 and inputs the index image data Sll to the image processing 

condition determining means 6. Meanwhile, the setting 
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information generating means 5 generates the setting 
information HO based on the image data SO or the reduced image 
data SO' (Step S3), and inputs the setting information HO to 
the image processing condition determining means 6. 

The tone setting means 23 of the image processing 
condition determining means 6 sets the tone conversion tables 
TO for converting the image data SO (or SO') according to the 
setting information HO, the desired reference tone correction 
curves (or the customized reference tone correction curves) 
selected by using the input means 8 from the memory 24 and 
the model tone correction curves (or the customized model tone 
correction curves) stored in the memory 24 (Step S4) , and the 
tone conversion means 22 carries out the tone conversion on 
the index image data Sll based on the tone conversion tables 
TO (Step S5) . The color correction conditions are then set 
based on the setting information HO, the reference color 
correction condition menu (or the customized reference color 
correction conditions) selected by the input means 8 from the 
memory 31, and the model color correction condition menu (or 
the customized model color correction conditions) 
corresponding to the model of the digital camera (Step S6) . 
The index image data Sll are subjected to the color correction 
processing by the color correction means 27 based on the color 
correction conditions that have been set (Step S7), and 
displayed on the monitor 7 (Step S8) . An operator views the 
index images, and, if necessary (Step S9 : YES) , corrects the 
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tones and/or densities of the index images by an input from 
the input means 8 or the DCMY keys 9 or corrects the color 
correction conditions by an input from the input means 8 (Step 
S10) . The procedure returns to Step S4 and the processing 
from Step S4 to Step S9, in which the tone conversion tables 
TO are newly set for the corrected tones and/or densities and 
the index image data Sll are subjected to the tone conversion 
and the color correction processing according to the newly 
set tone conversion tables TO and the color correction 
conditions inorder tobedisplayedonthe moni tor 7 , is repeated 
The "correction" includes correction of the reference tone 
correction curves, the model tone correction curves, the 
reference color correction conditions, and the model color 
correction conditions. If no correction is carried out, or 
when the correction is completed, a result at Step S9 becomes 
negative, and the finally set tone conversion tables TO and 
the color correction conditions are determined for the image 
data SO (or SO') . When the reference tone correction curves, 
the model tone correction curves, the reference color 
correction conditions, and the model color correction 
conditions are corrected, the curves and the conditions after 
the correction are stored in the memory 24 (for the tone curves) 
and in the memory 31 (for the color correction conditions) 
by being related to a name including information of a user 
and a photographing condition. 

The processing condition determining means 33 compares 
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the number of lattice points of the 3DLUT calculated based 
on the number of bits of the image data SO with the number 
YO (or YO ' in the case of reduction) of pixels in the image 
represented by the image data SO (Step S13) . If the number 
of lattice points of the 3DLUT is equal to or larger than the 
number YO (or YO ' ) of pixels (Step S13 : YES), the image 
processing conditions (the tone conversion tables TO and_the 
color correction conditions) are input to the processing means 
10 (Step S19) . If the number of lattice points is smaller 
than the number YO (or YO ' ) of pixels (Step S13: NO), the 
procedure advances to the processing to generate the 3DLUT 
(Step S14 - S17) . In the processing to generate the 3DLUT, 
the tone conversion is carried out on the image data SO (or 
SO') having the reduced number of bits according to the tone 
conversion tables TO (Step S14), and the color correction is 
then carried out by using the color correction conditions (Step 
SI 5 ) . The conversion to the sRGB color space and the conversion 
to the color space for printing are also carried out (Step 
S16) , and the print image data S5 are obtained- The LUT 
generating means 30 generates the 3DLUT (Step S17) by finding 
the relationship between the image data SO (or SO') having 
the reduced number of bits and the print image data S5 for 
each of the RGB colors. The 3DLUT is output to the processing 
means 10 (Step S18) . 

As has been described above, the processing means 10 
obtains the converted image data S12 by converting the image 
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data SO (or SO') according to the 3DLUT and by carrying out 
the interpolation processing on the 3DLUT , if the 3DLUT is 
input thereto. However, if the image processing conditions 
comprising the tone conversion tables TO and the color 
correction conditions are input to the processing means 10, 
the processing means 10 obtains the converted image data_S12 
by carrying out the tone conversion processing and the color 
correction processing on each of the pixels of the image data 
SO (or SO') according to the image processing conditions, and 
the converted image data S12 are obtained. 

After the image data SO read from the memory card 2 are 
converted by the processing means 10, the enlargement 
processing by the enlargement means 12 is carried out if 
necessary. The sharpness processing is then carried out by 
the sharpness processing means 13, and the printer 14 outputs 
the image data as the print P. 

The sharpness gain in the sharpness processing is also 
control 1 able . 
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